Method and system for data processing with data backup

ABSTRACT

The invention relates to backup processing for performing backup of data used in an information processing device having a storage unit. When data has been updated, updated bit information indicating that the data has been updated is stored in an update bitmap management table stored in the storage unit. When the number of updated bit information in the update bitmap management table has reached a differential backup reference value for estimating differential backup time, the backup of data corresponding to the updated information is commanded. When the command for the backup is received, the updated bit information stored in the update bitmap management table in the storage unit is read out. Then, the backup of the data corresponding to the updated bit information is obtained.

INCORPORATED BY REFERENCE

This application is a continuation of U.S. application Ser. No.10/914,095, filed Aug. 10, 2004 now U.S. Pat. No. 7,099,903, and alsoclaims priority from Japanese application JP 2004-126779 filed on Apr.22, 2004, the contents of which are hereby incorporated by referenceinto this application.

BACKGROUND OF THE INVENTION

The present invention relates to backup processing for performing backupof data used in an information processing device. More specifically, theinvention relates to a technology that is effective when applied to thebackup processing, which facilitates estimation of backup processingtime and recovery processing time.

Conventionally, when performing backup of data used in informationprocessing devices, a differential backup method is employed forreducing the amount of the backup. For managing a difference of databefore and after a change, there is provided a method that uses adifferential bitmap. In a backup processing method that uses thisdifferential bitmap, a differential backup or a full backup is performedaccording to the number of updated bits marked on the differentialbitmap (refer to JP-A-7-84728, for example).

SUMMARY OF THE INVENTION

In the conventional backup processing method, a backup processingrequest is basically made at a predetermined date and time according toschedule management. However, scheduling in view of the amount of backupis not performed. Thus, if differential backups are performed atpredetermined dates and times according to the schedule management, theamount of data to be backed up differs for each differential backup. Thetime for backup processing therefore differs for each differentialbackup, so that it becomes difficult to estimate the backup processingtime. Further, if a failure should occur, the amount of backup data forrecovery processing also differs for each backup. Thus, it also becomesdifficult to estimate the time for the recovery processing.

An object of the present invention is therefore to solve theabove-mentioned problems and provide a technology that can facilitateestimation of backup processing time and recovery processing time byobtaining differential backups of a predetermined size.

In a backup processing system of the present invention for performingbackup of data used in an information processing device, when the numberof updated bit information in an update bitmap management table hasreached a predetermined reference value for estimating differentialbackup processing time, backup of data corresponding to the updated bitinformation is obtained.

In the backup processing system according to the present invention,which may be a computer, the information processing device, or a programor an object for performing backup processing, the update bitmapmanagement table is provided for either of storage devices in the hostcomputer or the storage device subsystem of the backup processingsystem. The update bitmap management table is provided for managingwhether data in the storage device of the backup processing system hasbeen updated, using a bitmap.

When data in a backup target region in the storage device has beenupdated through execution of database processing, the bitmap processingunit of the present invention stores in the update bitmap managementtable in the storage device updated bit information indicating that thedata has been updated, reads out updated information from the updatebitmap management table, and counts the number of the updatedinformation.

Then, the bitmap processing unit compares the counted number of theupdated bit information with the differential backup reference value forestimating the differential backup time. When the counted number of theupdated bit information has reached the differential backup referencevalue, the bitmap processing unit commands a backup processing unit toperform backup of data corresponding to the updated bit information.

The differential backup reference value is calculated from the size ofthe storage region for storing data for differential backup and the sizeof data corresponding to updated bit information. For calculation of thedifferential backup reference value, a backup region is accessed, forexample, and the size of the storage region for storing the data for thedifferential backup is obtained. Then, division of the obtained size bythe size of data equivalent to one updated bit information is performed,and the result of the division with a resulting remainder rounded downis set to the differential backup reference value.

The differential backup reference value may also be calculated from thetime assigned for obtaining a backup and the time required for backingup the data equivalent to one updated bit information. Morespecifically, the time assigned for obtaining the backup is divided bythe time required for transferring the data equivalent to one updatedbit information from a backup target region to the backup region. Then,the result of the division with the resulting remainder rounded down maybe set to the differential backup reference value.

The backup processing unit of the present invention receives the commandfor the backup from the bitmap processing unit, reads out updatedinformation stored in the update bitmap management table in the storagedevice, reads out data corresponding to the updated bit information fromthe backup target region in the storage device, and then stores the datain the backup region, thereby obtaining the differential backup.

As described before, in the present invention, when the number ofupdated bit information in the update bitmap management table hasreached the differential backup reference value, the differential backupis obtained. Thus, the size of the data for the differential backupbecomes a predetermined size equivalent to the differential backupreference value. Accordingly, estimation of the processing time requiredfor obtaining the differential backup can be performed easily. Further,even if recovery processing is performed when a failure occurs, recoveryfrom the differential backup of the predetermined size will beperformed. Estimation of the processing time required for the recoveryfrom the differential backup can be performed easily.

According to the present invention, when the number of updated bitinformation in the update bitmap management table has reached thepredetermined reference value for estimating the backup processing time,backup of data corresponding to the updated bit information is obtained.Thus, by obtaining the differential backup of the predetermined size,estimation of the processing times required for backup processing andrecovery processing can be performed easily.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing a schematic configuration of a backupprocessing system according to a first embodiment of the presentinvention;

FIG. 2 is a flowchart showing processing steps for page input requestprocessing in the first embodiment;

FIG. 3 is a flowchart showing processing steps for buffer stealprocessing in the first embodiment;

FIG. 4 is a flowchart showing processing steps for checkpoint processingin the first embodiment;

FIG. 5 is a flowchart showing processing steps for update processing ofan update bitmap management table in the first embodiment;

FIG. 6 is a flowchart showing processing steps for update processing ofthe update bitmap management table when high-volume update processinghas been detected, in the first embodiment;

FIG. 7 is a flowchart showing processing steps for backup processing inthe first embodiment;

FIG. 8 is a table showing an example of a backup management tablemanaged by a host computer in the first embodiment;

FIG. 9 is a diagram showing a schematic configuration of a backupprocessing system in a second embodiment of the present invention;

FIG. 10 is a flowchart showing processing steps for write commandprocessing in the second embodiment;

FIG. 11 is a table showing an example of a backup management tablemanaged by a storage device in the second embodiment; and

FIGS. 12A and 12B show examples of improving the input and outputefficiency of the backup processing system in the first embodiment.

DESCRIPTION OF THE EMBODIMENTS First Embodiment

A backup processing system according to a first embodiment of thepresent invention, for performing backup of database data used inprocessing on a database will be described below.

FIG. 1 is a diagram showing a schematic configuration of the backupprocessing system in this embodiment. As shown in FIG. 1, a hostcomputer 100 in this embodiment includes a question analysis processingunit 101, a DB operation processing unit 102, a DB buffer managementunit 103, a check point processing unit 104, a bitmap processing unit105, a backup processing unit 106, and a recovery processing unit 107.

The question analysis processing unit 101 is the processing unit thatreceives a processing request on the database and analyzes theprocessing request. The DB operation processing unit 102 is theprocessing unit that performs operation processing on the databaseaccording to the content of the analyzed processing request. The DBbuffer management unit 103 is the processing unit that stores a DB blockreceived from a storage device 110 in a DB buffer 108 for management andcontrols access to a backup target DB region 111 in the storage device110 through the DB buffer 108.

The checkpoint processing unit 104 transmits a request for writing allDB blocks updated at the DB buffer 108 from the host computer 100 to thestorage device 110 when the need for reflecting the content of the DBbuffer 108 on the backup target DB region 111 in the storage device 110occurs, and commands the bitmap processing unit 105 to update an updatebitmap management table 109.

When data in the backup target DB region 111 has been updated, thebitmap processing unit 105 stores updated bit information indicating thedata has been updated in the update bitmap management table 109 in amain storage device. When the number of updated bit information in theupdate bitmap management table 109 has reached a differential backupreference value for estimating differential backup processing time, thebitmap processing unit 105 commands the backup processing unit 106 toperform backup of data in the backup target DB region 111 correspondingto the updated bit information to a differential backup volume 113. Inthis embodiment, management of updated data is performed using an updatebitmap. However, a method using location information and identificationinformation on the updated data can also be adopted.

The backup processing unit 106 receives the command for the backup,reads out the updated bit information stored in the update bitmapmanagement table 109 in the main storage device, and duplicates the datain the backup target DB region 111 corresponding to the updated bitinformation to the differential backup volume 113 or duplicates all datain the corresponding DB region in the backup target DB region 111 to thefull backup volume 112 so as to obtain a backup.

The recovery processing unit 107 duplicates data from the full backupvolume 112 or the differential backup volume 113 to the backup target DBregion 111 when a failure occurs, thereby performing recovery processingof the databases.

A program for causing the host computer 100 to function as the questionanalysis processing unit 101, DB operation processing unit 102, DBbuffer management unit 103, checkpoint processing unit 104, bitmapprocessing unit 105, backup processing unit 106, and recovery processingunit 107 is recorded in a recording medium such as a CD-ROM and storedin a magnetic disc or the like. Then, the program is to be loaded into amemory for running. As the recording medium for recording the program,other recording medium except for the CD-ROM may be employed. Further,the program may be installed from the recording medium to an informationprocessing device, for use. Alternatively, the recording medium may beaccessed through a network so as to use the program.

The host computer 100 further includes the DB buffer 108 and the updatebitmap management table 109.

The DB buffer 108 is a storage region for temporarily holding thecontent of the backup target DB region 111 in the storage device 110.The update bitmap management table 109 is the management table formanaging whether data in the backup target DB region 111 in the storagedevice 110 has been updated or not by using bit information.

The storage device 110 includes the backup target DB region 111, fullbackup volume 112, differential backup volume 113, and backup controland management information 114.

The backup target DB region 111 is the storage region for storingdatabase data to be backed up. The full backup volume 112 is the storageregion for storing all data in the backup target DB region 111 at thetime of a full backup.

The differential backup volume 113 is the storage region for storingdata in the backup target DB region 111 corresponding to updated bitinformation, at the time of a differential backup. The backup controland management information 114 is the management information indicatingthe name of a DB region on which backup processing has been performed,the type of backup, the start time and the end time of the backup, abackup destination and updated bitmap information, and the like.

When processing in a database management system is started by the hostcomputer 100 in this embodiment, the question analysis processing unit101 receives a request for processing on the database and performsanalysis processing. Then, the DB operation processing unit 102 performsoperation processing on the database according to the content of theanalyzed processing request. At this occasion, the DB buffer managementunit 103 performs input request processing on a page including dataneeded for the database processing, stores a DB block received from thestorage device 110 in the DB buffer 108, and commands the bitmapprocessing unit 105 to update the update bitmap management table 109 asnecessary.

FIG. 2 is a flowchart showing processing steps for the page inputrequest processing. At step 201, the DB buffer management unit 103 inthe host computer 100 executes search processing for performing a searchin the DB buffer 108, and checks whether a page requested for thedatabase processing is stored in the DB buffer 108 or not.

At step 202, the DB buffer management unit 103 checks the result of thesearch processing. When there is not a buffer hit, or when the requestedpage is not stored in the DB buffer 108, the operation proceeds to step203.

At step 203, the DB buffer management unit 103 checks whether a freebuffer is present in the DB buffer 108 or not. If there is the freebuffer, the operation proceeds to step 204. If there is not the freebuffer, the operation proceeds to step 205.

At step 204, the free buffer in the DB buffer 108 is obtained. On theother hand, at step 205, buffer steal processing is performed as shownin FIG. 3, thereby obtaining a buffer in the DB buffer 108.

At step 206, the DB buffer management unit 103 reads data on therequested page from the backup target DB region 111 in the storagedevice 110, and then stores the data on the requested page in the freebuffer obtained at step 204 or the buffer obtained at step 205.

At step 207, the DB buffer management unit 103 returns the bufferaddress of the buffer in which the data on the requested page has beenstored at step 206 or the buffer address of the buffer for which thebuffer hit has been found at step 202 to the calling source of the pageinput request processing, thereby completing the processing.

FIG. 3 is a flowchart showing processing steps for buffer stealprocessing in this embodiment. At step 301, the DB buffer managementunit 103 in the host computer 100 searches for a buffer least recentlyused among an LRU (Least Recently Used) chain in the DB buffer 108, andobtains the buffer address of the buffer searched for.

At step 302, the DB buffer management unit 103 refers to updatedinformation indicating whether data in the buffer is updated or not, andchecks whether the data in the buffer is updated in the DB buffer 108 ornot. If the data in the buffer is updated, or a request for outputtingthe data in the buffer to the storage device 110 is present, theoperation proceeds to step 303. The updated information is stored in apredetermined region in the buffer, other table, or the like when thedata in the buffer is updated.

At step 303, a write command for writing the content of the buffer tothe storage device 110 is created, and the write command is transmittedto the storage device 110, thereby making a request for writing the pageof the buffer. The storage device 110 receives the write command, writespage data to the cache memory and the backup target DB region 111 of thestorage device 110, and reflects the updated content of the buffer onthe cache memory and the backup target DB region 111 of the storagedevice 110. Alternatively, writing to the backup target DB region 111may be performed just by performing writing to the cache memory of thestorage device 110.

At step 304, the DB buffer management unit 103 gives the accessdestination address to be accessed by the created write command to thebitmap processing unit 105, and commands the bitmap processing unit 105to update bit information of the update bitmap management table 109,corresponding to the data in the buffer.

At step 305, the DB buffer management unit 103 returns the address ofthe buffer obtained at step 301 to the calling source of the buffersteal processing, thereby completing the processing.

When the need for reflecting the content of the DB buffer 108 on thebackup target DB region 111 in the storage device 110 arises, thecheckpoint processing unit 104 in the host computer 100 in thisembodiment transmits a request for writing all DB blocks updated at theDB buffer 108 from the host computer 100 to the storage device 110 andcommands the bitmap processing unit 105 to update the update bitmapmanagement table 109.

FIG. 4 is a flowchart showing processing steps for checkpoint processingin this embodiment. At step 401, the checkpoint processing unit 104creates a checkpoint acquirement start log indicating that acquirementof a checkpoint has been started and stores the checkpoint acquirementstart log in a log buffer.

At step 402, the DB buffer 108 is locked, and update processing on theDB buffer 108 is temporarily stopped.

At step 403, the write command for writing pages in the DB buffer 108waiting for output or all pages updated in the DB buffer 108 to thestorage device 110 is created, and the checkpoint processing unit 104transmits the write command to the storage device 110, thereby making arequest for writing the pages. The storage device 110 receives the writecommand, writes the data on the pages to the cache memory and the backuptarget DB region 111 of the storage device 110, thereby reflecting theupdated content of the DB buffer 108 on the cache memory and the backuptarget DB region 111 of the storage device 110. Alternatively, writingto the backup target DB region 111 may be performed just by performingwriting to the cache memory of the storage device 110.

At step 404, the checkpoint processing unit 104 gives the accessdestination address to be accessed by the created write command to thebitmap processing unit 105, and commands the bitmap processing unit 105to update bit information in the update bitmap management table 109,corresponding to the updated page data.

At step 405, locking of the DB buffer 108 is cancelled, and updateprocessing on the DB buffer 108 is resumed.

At step 406, the checkpoint processing unit 104 creates a checkpointacquirement completion log indicating that acquirement of the checkpointhas been completed and stores the checkpoint acquirement completion login the log buffer.

When data in the cache memory and the backup target DB region 111 of thestorage device 110 has been updated by the DB buffer management unit 103and the checkpoint processing unit 104 as described above, the bitmapprocessing unit 105 of the host computer 100 in this embodiment storesin the update bitmap management table 109 in the main storage deviceupdated bit information indicating that the data has been updated. Whenthe number of updated bit information in the update bitmap managementtable 109 has reached the differential backup reference value forestimating the differential backup processing time, the bitmapprocessing unit 105 commands the backup processing unit 106 to performbackup of data in the backup target DB region 111, corresponding to theupdated bit information to the differential backup volume 113.

FIG. 5 is a flowchart showing processing steps for update processing ofthe bitmap management table in this embodiment. At step 501, the bitmapprocessing unit 105 of the host computer 100 receives from the DB buffermanagement unit 103 or the checkpoint processing unit 104 the accessdestination address to be accessed by the write command. Then, thebitmap processing unit 105 calculates the target bitmap position fromthe access destination address.

At step 502, the bitmap processing unit 105 reads the update bitmapmanagement table 109 in the main storage device, and checks whether bitinformation in the target bitmap position calculated at step 501 is off.If it has been found that the bit information in the target bitmapposition is off, the operation proceeds to step 503.

At step 503, the bitmap processing unit 105 turns on the bit informationin the target bitmap position, thereby storing in the update bitmapmanagement table 109 updated bit information indicating that data in thebackup target DB region 111 corresponding to the target bitmap positionhas been updated.

At step 504, the bitmap processing unit 105 reads bit information inrespective bitmap positions in the update bitmap management table 109,and counts the number of the updated bit information of which the bitinformation is on, thereby calculating the number of updated bits.

At step 505, the number of the updated bits calculated at step 504 iscompared with the differential backup reference value for estimating thedifferential backup processing time. If the number of the updated bitshas reached the differential backup reference value, the operationproceeds to step 506.

At step 506, the bitmap processing unit 105 commands the backupprocessing unit 106 to perform backup of data in the backup target DBregion 111, corresponding to the updated bit information, to thedifferential backup volume 113.

The differential backup reference value is herein calculated from thesize of the storage region of the differential backup volume 113 forstoring data for differential backup and the size of the datacorresponding to the updated bit information. For calculation of thedifferential backup reference value, the differential backup volume 113is accessed, for example, and the size of the storage region for storingthe data for the differential backup is obtained. Then, divisionexpressed in the following Formula 1 is performed, and the result of thedivision with a resulting remainder rounded down is set to thedifferential backup reference value.Differential Backup Reference Value=(Differential Backup Data StorageRegion Size)/(Size of Data Equivalent to Updated Bit SeriesInformation).  [Formula 1]

It is assumed that the size of the data equivalent to one updated bitinformation is set in advance at the time of creation of the backuptarget DB region 111 and the update bitmap management table 109.

The differential backup reference value may also be calculated from thetime assigned for acquirement of the backup and the time required forbacking up the data equivalent to one updated bit information. Morespecifically, the time that can be assigned for obtaining thedifferential backup is received from the user using an input device orthe like in advance, and then division expressed in the followingFormula 2 is performed. The result of the division with the resultingremainder rounded down is then set to the differential backup referencevalue.Differential Backup Reference Value=(Time Assigned for DifferentialBackup)/(Time Required for Backup of Data Equivalent to One Updated BitInformation).  [Formula 2]

It is assumed that the time required for backing up the datacorresponding to one updated bit information is set in advance from thedata transfer rates of the cache memory of the storage device 110,magnetic disk devices, and the like and the size of the data equivalentto one updated bit information.

The bitmap processing unit 105 in this embodiment commands the backupprocessing unit 106 to perform backup to the differential backup volume113 at step 506. As an alternative to this method, the number of updatedbits is accumulated and recorded for each command for differentialbackup, and when the accumulated number of the updated bits has reachedthe reference value for starting the full backup, the bitmap processingunit 105 may command the backup processing unit 106 to perform backup ofall data corresponding to bit information in the update bitmapmanagement table 109.

When the accumulated amount of data for differential backup has exceededthe amount of data for full backup, the full backup is obtained, usingthis processing. The processing time required for recovery processingcan be thereby reduced.

It is assumed that the reference value for starting the full backup iscalculated from the size of data when the full backup is performed andthe size of data equivalent to one updated bit information. Forcalculation of the reference value for starting the full backup, thebackup target DB region 111 is accessed, for example, and the size ofthe data for the full backup is obtained. Then, division expressed inthe following Formula 3 is performed, and the result of the divisionwith a resulting remainder rounded down is set to the reference valuefor starting the full backup.Reference Value for Starting Full Backup=(Size of Data for FullBackup)/(Size of Data Equivalent to One Updated BitInformation).  [Formula 3]

It is assumed that the size of the data equivalent to one updated bitinformation is set in advance at the time of creation of the backuptarget DB region 111 and the update bitmap management table 109, asdescribed before.

As an alternative to this method, in view of processing overhead whenthe amount of data for the full backup is processed by differentialbackups using a plurality of write commands, by dividing the processingoverhead by the time required for backup of data equivalent to one bitinformation, and subtracting the resulting value from the result of thedivision using Formula 3, the reference value for starting the fullbackup may be set to a lower value.

On the other hand, if the number of updated bits has reached thedifferential backup reference value in a short time due to execution ofhigh-volume batch update processing, it is sometimes inappropriate toperform differential backup. Thus, when the number of updated bits hasreached the differential backup reference value within an updateprocessing detection time, which is the time for detecting high-volumeupdate processing, the number of updated bits may be checked when theupdated amount has decreased to a certain level. Then, either ofdifferential backup or full backup may be performed according to thenumber of the updated bits.

FIG. 6 is a flowchart showing processing steps for update processing ofupdate bitmap management table when high-volume update processing hasbeen detected, in the first embodiment. As shown in FIG. 6, the sameprocessing as those from step 501 to step 505 in FIG. 5 is performed.

At step 601, the bitmap processing unit 105 reads out backup completiontime information indicating the date and time of completion of apreceding backup acquirement from the backup control and managementinformation 114. Then, the bitmap processing unit 105 calculates adifference between the read date and time and the current date and timeto obtain the time elapsed from the preceding backup acquirement. Then,the bitmap processing unit 105 compares the elapsed time obtained withthe update processing detection time, which is a predetermined timerequired for detecting high-volume update processing to check whetherthe elapsed time is smaller than the update processing detection time orwhether the number of the updated bits has reached the differentialbackup reference value within the update processing detection time.Then, if the number of the updated bits has reached the differentialbackup reference value within the update processing detection time, theoperation proceeds to step 602.

At step 602, the bitmap processing unit 105 counts the number of updatedbits in the update bitmap management table 109 at a predeterminedinterval of time to obtain the number of the increment of the updatedbits. Then, the bitmap processing unit 105 repeats processing ofmonitoring the number of the increment of the updated bits until thenumber of the increment of the updated bits within the predeterminedtime becomes less than the reference value for detecting updateprocessing.

Then, when the number of the increment of the updated bits within thepredetermined time has become less than the reference value fordetecting the update processing, the bitmap processing unit 105 comparesthe number of the updated bits at that point with the reference valuefor starting the full backup. When the number of the updated bits hasreached the reference value for starting the full backup, the bitmapprocessing unit 105 commands the backup processing unit 106 to performbackup of all data in the corresponding DB region in the backup targetDB region 111 to the full backup volume 112. When the number of theupdated bits has not reached the reference value for starting the fullbackup, the bitmap processing unit 105 commands the backup processingunit 106 to perform backup of data in the backup target DB region 111corresponding to the information of the updated bits to the differentialbackup volume 113.

It is assumed that the time for detecting update processing is set fromthe processing time for performing processing that involves high-volumeupdate processing such as batch processing executed by the host computer100. It is also assumed that the reference value for detecting theupdate processing within the predetermined time is set from the numberof the increment of updated bits during the update processing detectiontime when the processing that involves the high-volume update processingis executed. If the average value of the processing time for performinghigh-volume batch update processing executed by the host computer 100 is60 minutes and the average number of the increment of updated bits is600 in the 60 minutes, for example, the update processing detection timeis set to 60 minutes, the predetermined time for checking the number ofthe increment of the updated bits is set to one minute, and thereference value for detecting the update processing is the number ofupdated bits of one, which is 10% of the average increment rate.

Upon receipt of a command for backup from the bitmap processing unit105, the backup processing unit 106 in the host computer 100 in thisembodiment reads out updated bit information stored in the update bitmapmanagement table 109 in the main storage device, and duplicates data inthe backup target DB region 111 corresponding to the updated bitinformation to the differential backup volume 113 or duplicates all datain the corresponding backup target DB region 111 to the full backupvolume 112, as described before, thereby obtaining a backup.

FIG. 7 is a flowchart showing processing steps for backup processing inthis embodiment. Upon receipt of a command for backup from the bitmapprocessing unit 105, the backup processing unit 106 in the host computer100 checks whether the content of the command is to perform full backupor not at step 701. If the content of the command is not to perform thefull backup, the operation proceeds to step 702.

At step 702, the backup processing unit 106 reads the updated bitmap forthe backup target DB region 111 for which the request for the backup hasbeen made, from the update bitmap management table 109 in the mainstorage device.

At step 703, the backup processing unit 106 duplicates the data of whichbit information is on in the updated bitmap read at step 702, from thebackup target DB region 111 to the differential backup volume 113, andstores management information such as the name of the DB region on whichthe differential backup has been performed, the type of the backup, thestart and end times of the backup, the backup destination, and updatedbitmap information in the storage device as the backup control andmanagement information 114.

FIG. 8 is a table showing an example of a backup management tablemanaged by the host computer in this embodiment. FIG. 8 shows an exampleof various management information when the backup control and managementinformation 114 is managed by the host computer 100. The backupmanagement table stores management information such as the name of theDB region of “DBAREA1-3” on which backup processing has been performed,the types of the backup such as “FULL”, “differential”, and updatedbitmap information of “111111111 . . . ”.

In this embodiment, when the number of updated bits has reached thedifferential backup reference value, a differential backup is obtained.Thus, the amount of data duplicated from the backup target DB region 111to the differential backup volume 113 at step 703 always becomes apredetermined size. Estimation of the processing time required for thebackup processing thus can be easily performed.

On the other hand, when the recovery processing unit 107 of the hostcomputer 100 performs database recovery processing by duplicating datafrom the differential backup volume 113 to the backup target DB region111 if a failure occurs, differential backup data of the predeterminedsize will be duplicated according to the content recorded in the backupmanagement table. Thus, estimation of the processing time required forthe recovery processing can also be performed easily.

At step 704, the backup processing unit 106 counts the number of updatedbit information of which bit information is on in the updated bitmapread at step 702 to obtain the number of updated bits. Then, the backupprocessing unit 106 adds the number of the obtained updated bits to theaccumulated value of the number of updated bits stored in the mainstorage device in the preceding processing. Then, the backup processingunit 106 stores the resulting value again in the main storage device,thereby recording the accumulated value of the number of updated bits.

At step 705, the backup processing unit 106 clears the update bitmapmanagement table 109 in the main storage device that stores the updatedbitmap for the backup target DB region 111 for which the backup requesthas been made.

On the other hand, when the content of the command received from thebitmap processing unit 105 is to perform full backup at step 701, theoperation proceeds to step 706.

At step 706, the backup processing unit 106 duplicates all data in thecorresponding DB region in the backup target DB region 111 for which thebackup request has been made to the full backup volume 112, and storesthe management information such as the name of the DB region on whichthe full backup has been performed, the type of the backup, the startand end times of the backup, the backup destination, and updated bitmapinformation in the storage device as the backup control and managementinformation 114.

At step 707, the backup processing unit 106 clears the update bitmapmanagement table 109 in the main storage device that stores the updatedbitmap for the backup target DB region 111 for which the backup requesthas been made and the accumulated value of the number of the updatedbits stored in the main storage device.

In the processing described before at step 703, the backup processingunit 106 duplicates the data of which bit information is on in theupdated bitmap read at step 702 from the backup target DB region 111 tothe differential backup volume 113. At this point, in order to reduceprocessing overhead at the times of transmission and reception andthereby improve the input and output efficiency of the backup processingsystem, a region corresponding to consecutive updated bit informationmay be collectively duplicated using one write command. Alternatively,when the number of updated bit information in a predetermined bitmaprange in the updated bitmap is equal to or more than the backupmodification reference value, the write command for backup of all dataincluding data corresponding to the bit information being off in thebitmap range as well may be created.

FIGS. 12A and 12B are diagrams showing examples in which the input andoutput efficiency has been improved in this embodiment. As shown inFIGS. 12A and 12B, in this embodiment, a region corresponding toconsecutive updated bit information is backed up by one operation, orall data including the data corresponding bit information being off(indicated by 0 in FIGS. 12A and 12B) in the predetermined bit map rangeas well is backed up, thereby improving the input and output efficiency.

The backup modification reference value is herein calculated from thetotal number of bits in the predetermined bitmap range and theprocessing overhead when the size of the data corresponding to theupdated bit information in the predetermined bitmap range is processedusing a plurality of write commands. The processing overheads resultingfrom the differential backup for the bitmap range equivalent to apredetermined unit such as a cylinder or a track by a plurality of writecommands are measured in advance, for example. Then, the average valueof the processing overheads is calculated. Finally, the result ofcalculation using the following formula 4 is set to the backupmodification reference value.Backup Modification Reference Value=(Total Number of Bits inPredetermined Bitmap Range−Average Value of Processing Overheads)/(TimeRequired for Backup of Data Equivalent to One Updated BitInformation).  [Formula 4]

The average value of the processing overheads is the value obtained byaveraging the processing overheads when the size of the datacorresponding to the updated bit information in the predetermined bitmaprange has been processed using a plurality of write commands. It isassumed that the time required for backup of data equivalent to oneupdated information is set in advance from the data transfer rates ofthe cache memory of the storage device 110, the magnetic disk devices,and the like, and the size of the data equivalent to one updated bitinformation.

As described above, according to the backup processing system in thisembodiment, when the number of updated bit information in the updatebitmap management table has reached the predetermined reference valuefor estimating the processing time of differential backup, backup of thedata corresponding to the updated bit information is obtained. By alwaysobtaining the differential backup of the data of the predetermined size,estimation of the processing times required for the backup processingand the recovery processing can be facilitated.

Second Embodiment

A backup processing system according to a second embodiment, whichperforms backup of database data by the storage device will bedescribed.

Though the update processing of the update bitmap management table andthe backup processing in the first embodiment were described to be theones performed by the host computer 100, these processing may becontrolled by the storage device 110.

FIG. 9 is a diagram showing a schematic configuration of the backupprocessing system in this embodiment. As shown in FIG. 9, the storagedevice 110 includes a command processing unit 901, a bitmap processingunit 902, a backup processing unit 903, and a recovery processing unit904.

The command processing unit 901 receives a request for writing data fromthe host computer 100 and updates the backup target DB region 111 andthe cache memory according to the content of the received request forwriting the data.

When data in the backup target DB region 111 has been updated, thebitmap processing unit 902 stores in the update bitmap management table109 in the memory of the storage device 110 updated bit informationindicating that the data has been updated. When the number of updatedbit information in the update bitmap management table 109 has reachedthe differential backup reference value for estimating the differentialbackup processing time, the bitmap processing unit 902 commands thebackup processing unit 903 to perform backup of data in the backuptarget DB region 111 corresponding to the updated bit information to thedifferential backup volume 113.

The backup processing unit 903 reads out the updated bit informationstored in the update bitmap management table 109 in the memory uponreceipt of the command for the backup, duplicates the data in the backuptarget DB region 111 corresponding to the updated bit information to thedifferential backup volume 113 or duplicates all data in thecorresponding DB region in the backup target DB region 111 to the fullbackup volume 112, thereby obtaining the backup.

The recovery processing unit 904 duplicates data from the full backupvolume 112 and the differential backup volume 113 to the backup targetDB region 111 when a failure occurs, thereby performing databaserecovery processing.

A program for causing the storage device 110 to function as the commandprocessing unit 901, bitmap processing unit 902, backup processing unit903, and recovery processing unit 904 is recorded on a recording mediumsuch as a ROM or the like and run. The recording medium for recordingthe program may be other recording medium except for the ROM. Theprogram may be installed from the recording medium to the informationprocessing device for use, or the recording medium may be accessedthrough the network to use the program.

Though other configurations in this embodiment are assumed to be thesame as those in the first embodiment, the DB buffer management unit 103and the checkpoint processing unit 104 in this embodiment, which aredifferent from those in the first embodiment, do not command the bitmapprocessing unit 902 to update bit information in the update bitmapmanagement table 109. Upon receipt of the write command through thecommand processing unit 901, the storage device 110 commands the bitmapprocessing unit 902 to update the update bitmap management table 109.

FIG. 10 is a flowchart showing processing steps for write commandprocessing in this embodiment. Upon receipt of a command from the hostcomputer 100, the command processing unit 901 in the storage device 110analyzes the type of the command and the access destination address fromthe received command, and recognizes that the received command is awrite command, at step 1001. It is assumed that, from the accessdestination address, by making a comparison with information in a deviceconfiguration management table indicating addresses assigned to aplurality of disk subsystems and respective magnetic disk devices of thedisk subsystems, the number of the disk control device and the number ofthe drive for the access destination address can be identified.

Next, at step 1002, the command processing unit 901 checks whether dataat the access destination address analyzed at step 1001 is held in thecache memory of the storage device 110 or not, and determines whetherthere is a cache hit.

In the case of a cache miss in which the data at the access destinationaddress is not held in the cache memory, the operation proceeds to step1003. Then, the number of the drive for the access destination addressis identified as described before. Then, to the disk access control unitof the storage device 110, a request for transferring the data at theaccess destination address from the magnetic disk device correspondingto the identified number of the drive to the cache memory is made. Thetransfer destination address is registered in the cache management tableby the unit 901.

At step 1004, the command processing unit 901 checks whether thetransfer processing described above has been completed or not. If thetransfer processing has been completed, the operation proceeds to step1005.

When it has been determined at step 1002 that there is a cache hit, orwhen the transfer processing at step 1004 has been completed, thecommand processing unit 901 performs updating of the data in the cachememory of the storage device 110 at step 1005. That is, the commandprocessing unit 901 writes the content of the data received from thehost computer 100 to the cache memory. Alternatively, the commandprocessing unit 901 may update the backup target DB region 111 of thestorage device 110 according to the write request received.

At step 1006, the command processing unit 901 checks whether thecorresponding address in the cache memory on which the data writing hasbeen performed is the address to be managed for differential backup orthe address in the backup target DB region 111. If the address is theone in the backup target DB region 111, the operation proceeds to step1007.

At step 1007, the access destination address on which the data writinghas been performed is given to the bitmap processing unit 902, and thecommand processing unit 901 commands the bitmap processing unit 902 toupdate bit information in the update bitmap management table 109corresponding to the data of which the updating has been performed.

Then, at step 1008, the command processing unit 901 reports completionof the write command processing to the host computer 100.

When data in the cache memory and the backup target DB region 111 in thestorage device 110 has been updated by the command processing unit 901as described before, the bitmap processing unit 902 in the storagedevice 110 in this embodiment stores in the update bitmap managementtable 109 in the memory updated bit information indicating that the datahas been updated. When the number of updated bit information in theupdate bitmap management table 109 has reached the differential backupreference value for estimating the differential backup processing time,the bitmap processing unit 902 commands the backup processing unit 903to perform backup of data in the backup target DB region 111corresponding to the updated bit information to the differential backupvolume 113.

This processing is the same as the processing by the host computer 100shown in FIG. 5. The update processing of the update bitmap managementtable by the storage device 110 will be described with reference to FIG.5.

After receiving the access destination address to be accessed by a writecommand from the command processing unit 901, the bitmap processing unit902 of the storage device 110 calculates the target bitmap position fromthe access destination address, at step 501.

At step 502, the bitmap processing unit 902 reads out the update bitmapmanagement table 109 in the memory, and checks whether bit informationin the target bitmap position calculated at step 501 is off or not. Ifit has been found that the bit information in the target bitmap positionis off, the operation proceeds to step 503.

At step 503, the bitmap processing unit 902 turns on the bit informationin the target bitmap position, thereby storing in the update bitmapmanagement table 109 updated bit information indicating that data in thebackup target DB region 111 corresponding to the target bitmap positionhas been updated.

At step 504, the bitmap processing unit 902 reads bit information inrespective bitmap positions in the update bitmap management table 109,and counts the number of the updated bit information of which the bitinformation is on, thereby calculating the number of updated bits.

At step 505, the bitmap processing unit 902 compares the number of theupdated bits calculated at step 504 with the differential backupreference value for estimating the differential backup processing time.If the number of the updated bits has reached the differential backupreference value, the operation proceeds to step 506.

At step 506, the bitmap processing unit 902 commands the backupprocessing unit 903 to perform backup of data in the backup target DBregion 111 corresponding to the updated bit information to thedifferential backup volume 113.

Calculation of the differential backup reference value is performed inthe same manner as in the first embodiment: the differential backupreference value may be calculated from the size of a storage region inthe differential backup volume 113 for storing data for differentialbackup and the size of the data corresponding to the updated bitinformation. Alternatively, the differential backup reference value mayalso be calculated from the time assigned for acquirement of the backupand the time required for backing up the data equivalent to one updatedbit information.

Further, as in the first embodiment, when the accumulated number ofupdated bits resulting from the differential backups has reached thereference value for starting the full backup, the bitmap processing unit902 may command the backup processing unit 903 to perform backup of alldata corresponding to bit information in the update bitmap managementtable 109.

Still further, as in the processing by the host computer 100 shown inFIG. 6, if the number of updated bits has reached the differentialbackup reference value within the update processing detection time fordetecting high-volume update processing, the number of updated bits maybe checked when the updated amount has decreased to a certain level.Then, either of differential backup or full backup may be performedaccording to the number of the updated bits.

More specifically, after the same processing as those from step 501 tostep 505 in FIG. 5 has been performed, the bitmap processing unit 902reads out backup completion time information indicating the date andtime of completion of a preceding backup acquirement from the backupcontrol and management information 114. Then, the bitmap processing unit902 calculates a difference between the read date and time and thecurrent date and time to obtain the time elapsed from the precedingbackup acquirement. Then, the bitmap processing unit 902 compares theobtained elapsed time with the update processing detection time, whichis the predetermined time required for detecting high-volume updateprocessing to check whether the elapsed time is smaller than the updateprocessing detection time or whether the number of updated bits hasreached the differential backup reference value within the updateprocessing detection time. Then, if the number of the updated bits hasreached the differential backup reference value within the updateprocessing detection time, the operation proceeds to step 602.

At step 602, the bitmap processing unit 902 counts the number of updatedbits in the update bitmap management table 109 at a predeterminedinterval of time to obtain the number of the increment of the updatedbits. Then, the bitmap processing unit 902 repeats processing ofmonitoring the number of the increment of the updated bits until thenumber of the increment of the updated bits within the predeterminedtime becomes less than the reference value for detecting the updateprocessing.

Then, when the number of the increment of the updated bits within thepredetermined time has become less than the reference value fordetecting the update processing, the bitmap processing unit 902 comparesthe number of the updated bits at that point with the reference valuefor starting the full backup. When the number of the updated bits hasreached the reference value for starting the full backup, the bitmapprocessing unit 902 commands the backup processing unit 903 to performbackup of all data in the corresponding DB region in the backup targetDB region 111 to the full backup volume 112. When the number of theupdated bits has not reached the reference value for starting the fullbackup, the bitmap processing unit 902 commands the backup processingunit 903 to perform backup of data in the backup target DB region 111corresponding to the information of the updated bits to the differentialbackup volume 113.

Upon receipt of a command for backup from the bitmap processing unit902, the backup processing unit 903 in the storage device 110 in thisembodiment reads out updated bit information stored in the update bitmapmanagement table 109 in the memory, and duplicates data in the backuptarget DB region 111 corresponding to the updated bit information to thedifferential backup volume 113 or duplicates all data in thecorresponding DB region in the backup target DB region 111 to the fullbackup volume 112, as described before, thereby obtaining a backup.

This processing is the same as the processing by the host computer 100,shown in FIG. 7. The backup processing by the storage device 110 will bedescribed with reference to FIG. 7.

Upon receipt of a command for backup from the bitmap processing unit902, the backup processing unit 903 in the storage device 110 checkswhether the content of the command is to perform full backup or not atstep 701. If the content of the command is not to perform the fullbackup, the operation proceeds to step 702.

At step 702, the backup processing unit 903 reads the updated bitmap forthe backup target DB region 111 for which the backup request has beenmade, from the update bitmap management table 109 in the memory.

At step 703, the backup processing unit 903 duplicates the data of whichbit information is on in the updated bitmap read at step 702, from thebackup target DB region 111 to the differential backup volume 113, andstores management information such as the name of the DB region on whichthe differential backup has been performed, the type of the backup, LUN,the start and end times of the backup, the backup destination, andupdated bitmap information in the storage device as the backup controland management information 114.

FIG. 11 is a diagram showing an example of a backup management tablemanaged by the storage device in this embodiment. FIG. 11 shows anexample of various management information when the backup control andmanagement information 114 is managed by the storage device 110. Thebackup management table stores management information including the nameof the DB region such as “DBAREA1-3” on which backup processing has beenperformed, the types of the backup such as “FULL” and “differential”,and updated bit map information such as “111111111 . . . ”. LUN in FIG.11 indicates the number for identifying an LU (logical unit) of thestorage device.

In this embodiment, when the number of updated bits has reached thedifferential backup reference value, a differential backup is obtained.Thus, the amount of data duplicated from the backup target DB region 111to the differential backup volume 113 at step 703 always becomes apredetermined size. Estimation of the processing time required for thebackup processing thus can be easily performed.

When the recovery processing unit 904 of the storage device 110 performsdatabase recovery processing by duplicating data from the differentialbackup volume 113 to the backup target DB region 111 when a failureoccurs, differential backup data of the predetermined size will beduplicated according to the content recorded in the backup managementtable. Thus, estimation of the processing time required for the recoveryprocessing can also be performed easily.

At step 704, the backup processing unit 903 counts the number of updatedbit information of which bit information is on in the updated bitmapread at step 702 to obtain the number of updated bits. Then, the backupprocessing unit 903 adds the number of the updated bits to theaccumulated value of the number of updated bits stored in the memory inthe preceding processing. Then, the backup processing unit 903 storesthe resulting value again in the memory, thereby recording theaccumulated value of the number of updated bits.

At step 705, the backup processing unit 903 clears the update bitmapmanagement table 109 in the memory that stores the updated bitmap forthe backup target DB region 111 for which the backup request has beenmade.

On the other hand, when the content of the command received from thebitmap processing unit 902 is to perform full backup, the operationproceeds to step 706.

At step 706, the backup processing unit 903 duplicates all data in thebackup target DB region 111 for which the backup request has been madeto the full backup volume 112, and stores the management informationsuch as the name of the DB region on which the full backup has beenperformed, the type of the backup, LU, the start and end times of thebackup, the backup destination, and updated bitmap information in thestorage device as the backup control and management information 114.

At step 707, the backup processing unit 903 clears the update bitmapmanagement table 109 in the memory that stores the updated bitmap forthe backup target DB region 111 for which the backup request has beenmade and the accumulated value of the number of the updated bits storedin the memory.

In the processing described before at step 703, the backup processingunit 903 duplicates the data of which bit information is on in theupdated bitmap read at step 702, from the backup target DB region 111 tothe differential backup volume 113. Alternatively, when the number ofupdated bit information in a predetermined bitmap range in the updatedbitmap is equal to or more than the backup modification reference value,data corresponding to bit information in the bitmap range may be backedup.

As described before, among the processing in this embodiment, the updateprocessing of the update bitmap management table and the backupprocessing are performed by the storage device 110. The updateprocessing of the update bitmap management table may be performed by thestorage device 110, and the backup processing may be performed by thehost computer 100.

More specifically, when data has been updated, updated bit informationindicating that the data has been updated is stored in the update bitmapmanagement table 109 in the storage device 110, which is the storagedevice subsystem. When the number of updated bit information in theupdate bitmap management table 109 has reached the differential backupreference value, the updated bit information is transmitted to thebackup processing unit 106 of the host computer 100. The backupprocessing unit 106 of the host computer 100 receives the updated bitinformation and obtains the backup of data corresponding to the updatedbit information through control by the host computer 100.

Since updated bitmap management is the processing that depends on anaccess destination address in the backup target DB region 111, themanagement can be efficiently performed by the storage device 110. Oncontrast therewith, the backup processing is sometimes to be performedby application processing already used by the host computer 100.Accordingly, by providing interface for transmitting updated bitmapinformation from the storage device 110 to the host computer 100 whenthe number of updated bits has reached the differential backup referencevalue, the backup processing by the host computer 100 can be performedin cooperation with the storage device 110.

As described above, according to the backup processing system in thisembodiment, when the number of updated bit information in the updatebitmap management table has reached the predetermined reference valuefor estimating the differential backup processing time, the backup ofdata corresponding to the updated bit information is obtained. Thus, byalways obtaining the differential backup of the data of thepredetermined size, estimation of the processing times required forbackup processing and recovery processing can be facilitated.

It should be further understood by those skilled in the art thatalthough the foregoing description has been made on embodiments of theinvention, the invention is not limited thereto and various changes andmodifications may be made without departing from the spirit of theinvention and the scope of the appended claims.

1. A database processing method for performing backup of data used in aninformation processing device having a storage means, the methodcomprising the steps of: storing in an update bitmap management tablestored in the storage means updated bit information indicating that datahas been updated, when the data has been updated; commanding the backupof data corresponding to updated bit information stored in the updatebitmap management table when a number of the updated bit informationstored in the update bitmap management table has reached a differentialbackup reference value for estimating differential backup processingtime; reading out the updated bit information stored in the updatebitmap management table in the storage means upon receipt of the commandfor the backup, and obtaining the backup of the data corresponding tothe update bit information stored in the update bitmap management table;estimating processing time required for the backup processing from asize of the data corresponding to the updated bit information based onthe differential backup reference value; estimating processing timerequired for a recovery processing from the size of data correspondingto the updated bit information and estimating a reference value fordetermining commanding of a full backup of data stored in the storagemeans when a increment of the updated bits in a perdetermined timeinterval is less than the reference value.
 2. A backup processing systemfor performing backup of data used in an information processing devicehaving a storage means, the system comprising: a bitmap processing unitfor storing in an update bitmap management table stored in the storagemeans updated bit information indicating that data has been updated,when the data has been updated, and commanding the backup of datacorresponding to updated bit information stored in the update bitmapmanagement table when a number of the updated bit information stored inthe update bitmap management table has reached a differential backupreference value for estimating differential backup processing time; abackup processing unit for reading out the updated bit informationstored in the update bitmap management table in the storage means uponreceipt of the command for the backup, and obtaining the backup of thedata corresponding to the update bit information stored in the updatebitmap management table; an estimating processing unit for estimatingprocessing time required for the backup processing from a size of thedata corresponding to the updated bit information based on thedifferential backup reference value, and estimating processing timerequired for a recovery processing from the size of data correspondingto the updated bit information, and for estimating a reference value fordetermining commanding of a full backup of data stored in the storagemeans when an increment of the updated bits in a predetermined timeinterval is less than the reference value.